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ABSTRACT 
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I. INTRODUCTION 

H*w can we represent in a computer program the kind 
of knowledge people manipulate easily and offtive-l^ 1 ? 
One of the significant discover ics of acts fie Lai intolliyenee 
has been how computationally difficult n-e iLie a Lem onto ry 
U'isks of vision, language., and common sense reasoning 
which we perform continually in the course of our everyday 
activities. The tcelhntCjU*s used % the artificially 
intelligent programs of the past decade arc simply not 
powerful enough to approach human performance over any 
wide rail Re of taskE, New mechanisms have recently been 
proposed by which the organisation of previously 
accumulated knowledge can assist active perception, find 
understanding- Briefly* the idea i$ that if there is 1*0 
little computation lime when a problem comes up, do Sonte 
of Lhe work in advance and keep the computed results 
available. This in itself is not an astonishing insight, 
though it does focus our attention on the relationship 
among im mediate perception, understanding* and long-term, 
real-world knowledge. It obviously should be easier to see 
something which has previously been. seen, and ihc question 
becomes how to organize and usa such previous experience. 

Minsky (1975] proposed a theory of "frames" as a 
mechanism for representing knowledge in the computer, A 
frame is a structure which represents knowledge about 8 
very limited domain. A frame produces a description of 
tlae object or action in question, storting with an invariant 
Structure common to all cases in its domain, and adding 
■certain features- according to particular observations. The 
resulting description is stated in terms of a limited number 
of descriptors. A critical point is that the frotOO* as the 
unit of i-opresented knowledge,, is quite large. Rather than 
being Ofl the order of a single properly or relation 
attributed to an object, it is on the order of a description 
of the object with additional in Format ion indicating 
relations with other frames. Minsky'S paper has evoked it 
great deal of discussion and interest in exploring further 
leva La of detail. It presents plausible and provocative 
examples of the application oF frames to different problems 
in artificial intelligence- Since then, Wjnograd [Chapter 
f], Bnbmw & Norman (Chapter G), Fahlman (1&73) 3 Rubin 
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(1975), and others. have begun to distinguLsh the various 
theoretical and technical Issues often grouped together in. 
discussions of frames. 

In discussions of frames, there is ei tendency for 
supporters of the idea to have an intuitively satisfying 
irvUrnat model of the theory which they have great 
difficulty making precise and connmin Lea ling to others, It 
can be difficult to distinguish clearly between the concept 
of frames and previous ideas, or evert to Slate the concepts 
precisely enough to evaluate them ai all- 3« this chapter, I 
attempt to provide an Intuitive model which can serve as a 
foundation for more precise statements. With itn Intuitive 
example in mind, I extract some of the proportion which 
are desirable in a frame representation. Next, I 3ttero.pl 
to distinguish those issues which are relevant to 
recognition, tin'll, is. the problem of selecting one of a fixed 
set of alternate interpretations for 0 collection of 
observations. I present am example of recognition (in a 
tiny world) for which adtUBl technical decisions are made. 
In the last section, I discuss the simplified model of 
frame-based recognition used by the example, and outline 
the limits of its applicability. 

II. IMPORTANT PROPERTIES OF FRAMES 

Some of the important properties of frames -as a 
representation lor knowledge ere listed below, to he 
discussed Lit more detail later. 

Jhircreptiort. A frame provides Sin elaborate structure for 
creating and maintaining f, description. A primitive 
element of Ibis description may bo expanded to a frame 
when its internal description becomes of interest. 

/nsidntifjtLurt. This is the process by wdtich the frame 
produces a description af the object being examined by 
substituting observed I** 1 predicted values, Features whose 
real properties Siave- not been observed are represented by 
default values. 
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Prtdictiart. The frame's predicted description can be used 
Id guide the collection of observations .for instantiation, [t 
also produces the defaults, which substitute for unobserved 
features. 

i/nsiLficnrieut, Different features of the frame description 
have different amounts of confidence. Borne are clear 
observations, others are choices among few alteni&livdS, and 
others arc default assignments. 

Variation. The dimensions and rjiEigss. of possible 
variation of each feature are limited and specified. 

Correction. Anomalies (bay indicate that the current 
frame is not correct, and that a different point of view is 
called for. The frame can analyse the anomaly to select a 
more appropriate replacement. 

PerZuriKztcan. For small changes in the observer or the 
observed, perturbation procedures correct the description 
without compLete re computation. 

Transformation. In case uF more significant changes, 
transformation procedure* propose frames suitable for the 
new si t oMicm. 


A. Scenario 

Consider for a moment an intuitive description of how a 
frame system might work in the everyday vision process. 
As you are walking through an unfamiliar house, you come 
to a normal interior-type door,, open it, unci walk through. 
At the moment that you open the door, your {entirely 
reasonable) expectations have already brought a "room 1 ’ 
frame to mind- There ls no delay in comprehending the 
fact that you sec four walls, floor, and ceiling, since you 
already "knew'' that they would be there, even without 
having soon thorn. Indeed, if these expectations had not 
boon fulfilled, and you had been presented -wDls, say, a 
seashore instead, you would exper ion*#- ft sense of 
disorientation,. You have found a room, however, and your 
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(mostly unconscious) analysis continues. The window cm 
the opp&sitt wall is incorporated Ln.1 d the room description 
which is forming in your mine!, very quickly because you. 
have available a number of prepackaged window 

descriptions, These descriptions Lire Also frames in their 
own right, buL will only be used as stereotypes unless you 
direct your attention to them. A bed in. the room causes 
the general "z-nom" frame to he replaced by a more specific 
"bedroom - frame, in which a dishwasher is no longer a 
serious possibility. The visual information already collected 
by the "room 1 ' frame, however, is still valid arid is 
incorporated into the description within the bedroom frame. 
Your attention passes over s clock near the bed and 
focuses cm the fireplace. The fact of its existence and the 
superficial properties (if fireplaces arc recorded in the top- 
level room frame, but sped her frame is activated to record 
the description of the fireplace in detail. That information 
is extraneous in the room frame, and needs a context of Its 
own. When questioned later, you will be able to answer 
detailed questions about the fireplace (perhaps noticing a 
subjective fee Ling of focussing attention on the fireplace 
and away from the rest of the room when answering), ymd 
you will be unable to say more about the clock than- that it 
was a clock mounted cn the wall. Quite pwsibly you will 
recall it as having hands in spile of the fact that, being a 
very modem clock, it had none. 

In constructing the description of the room, you would 
have verified in passing that it wa-s a clock, perhaps by 
noticing the characteristic hour marks, and then allowed 
the stereotype description of the clock feature to provide 
the rest. This kind of self-deception by expectation is a 
result of the diligence of the frame mechanism attempting 
to extract a maximally detailed description from a minimal 
amount of input information. I use an example where the 
default assignment was incorrect because there is less doubt 
in sn-rh cases that the information was supplied by the 
frame. In general, of course, such itereetypoS are correct, 
making it uncertain whether the information came from a 
default description or An actual observation. 
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B- Description 

A {rams has a small domain of *stpyu-^tiand -contains 
the kno-wlciclgfc necessary to create :l description of an -object 
in Lhot domain. Some knowledge tells how.- to take a set 
of observations and create a correspondence between those 
observations and the descriptive mechanism of the frame. 
Other knowledge allows the frame to predict some features 
of the description after observing others. Transformation 
knowledge maintains the description under small changes of 
viewpoint, to avoid having to redescribe the scene. We can 
bs-gin to make a distinction between the knowledge in r 
frame which is about the object being described (tire 
expected features and the relations holding among them), 
and that which manipulates the description In response to 
new observations Or changes in viewpoint. The latter kind 
deals with the relations among descriptions, and 50 could, be 
considered as describing the properties of the domain and 
not of an individual object. 

There is an important point to be made about the 
relation between the local nature of observations and the 
global nature of descriptions. The glcbai order imposed -on 
the sensory inputs must be leaned: it is not intrinsically 
present in what is seen. Any theory of representation of 
knowledge, and of recognition in particular, is trying to 
explain exactly how w« impose the order we have Learned 
through experience Onto the extra me3y varied and 
disordered sensory inputs we receive. The important point, 
then, is that any global knowledge contained by a 
description must have come from the internal 
representation. it could not- come from the observations 
alone. This helps to <Jsplain how prior knowledge is not 
only helpful, but necessary for understanding and 
perception. 

The description of an object includes a number of 
features of that objeet (which W Lnograd in Chapter 7 calls 
IklPs, fee IMPortant elements) and the relations which 
hold among those features. The description also specifies a 
limited set from which those features ami relations are 
chosen, It is reasonable to ask about the stove when 
thinking of e kitchen, but in an "office" frame the stove is 
not mentioned, not even to say that there is none. Tins 
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description may also contain information computed from 
ebtervations, but ■which is cer Lain 1 y not in the sensory 
image—For example, how many prople can he served fit (tie 
dining room table. 


C„ Instantiation 

Instantiation is the procc-ss by wlncli a fram-p creates a 
description from oh be neat ions of an object in ii s domain- 
Part of a frame is a description schema which make* 
bniJding a description a matter oT making a number of 
simple decisions and choosing from among limited sots of 
Oitey-nAti vpt, \lost of the choices involved in cons true ting 1 a 
description have already been made by selecting that frame. 
For ok am pie, we know that virtually all rooms are bounded 
by plane polygonal surfaces, and that almost all of those 
consist of six rectangle*: four walls, floor, and ceiling. 
In us the part of the descriptive process that describes the 
walls can use a quick, simple test for large deviations from 
the expected four-wall description. Jf no deviations are 
noticed, the complex description of fo V r perpendicular 
rectangular wails can be used in the particular room 
description. This process, based on eur experience with 
typical rooms and the appearance of typical rooirt-edg^s 
from the usual perspective, makes it possible to verify a 
complex portion of a description in much less time than 
would be required to generate it from scratch. 

Our actual experience with rooms comes mostly from 
particular kinds of room*; rooms in homes, ofFiccs, schools, 
:md other buildings. As we instantiate the general "room" 
frame we record characteristics which could kdc-ng to any 
kind of roopu, At the inrae time, however, the features we 
see specify which particular kind oF room is before us, and 
bring in the frame corresponding to that kind of room, 
This is the process of refinement: within □ frame of 
common characteristics, making decisions which determine a 
parti c u .a r and more apecialned frame in which to coniinue 
the description. For example, in the scenario, upon 
not Lei fig the bed, the room frame becomes a bedroom frame 
which affects. some (not all) of the remaining alt*rnatlvea 
tn the description, 
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R* Correction 

In most common casus of recognition the identity of the 
object being described is not initially known, so selecting 
ths proper fraiq* to instantiate is part of the problem. 
Ihe current host guess" frame attempts to create a 
correspondence between what it esipeets to sm- and the 
slMfmaiiona actually available. If it runs into an 
Observation which is incompatible with its domain, that 
observe Li qa can often indicate ai good replace me nt framt. 
i-or rample f an attempting to recognise a large, fmsr-Iegeed 
animal, a reasonable guess would be that it is a horse. 
Small horns, however, are incompatible with a "horse* 
hypothesis, but strongly suggest a cow, A single I urge horn 
w_ould: suggest a unicorn. Notice, however, that much of 
the previously gathered information, such o? color and 
location of various body parts, is valid in any of the three 
potential frames, and need not be observed anew within the 
new frame. Falilman [IdTS) is. currying on research along 
these lines, and I discuss these issuer in more detail in 
Section ill.EL 


E r Default Values 

When some feature of a description baa not been 
observed, either because it is hidden or becau.se U simply 
has not yet been attended to, the frame can still make 
quite an accurate prediction about that feature. This is 
true even if the object has not been observed at all yet, 
and the only basis for prediction is personal, idiosyncratic 
experience. For example, if 1 mention a bench ball, I 
immediately conjure up nn image of a particular ball with 
ri_d ar.i .1 white stripes. These- default values arc very weakly 
bound features of the description in my Twachball" f tarns. 
II would take very little sensory evidence to make me 
replace thorn with hotter data for a particular description. 
On the other hand, if 1 see a line drawing of a cube 1 
have a vary strong e*psctaiion of a hidden corner and three 
more faces, and these esipectationa would be quite hard to 
replace. 

These default values have two- 


quite important uses. 
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1 he first is In guiding ihe proce-ss of recognising and 
instantiating a particular dese rLpi ion by suggesting what 
features to look for and where to expect them. The second 
is to provide 4)asters to Questions for which observation* 
have not yet been mad#, [rt this way, Lho frame represents 
our inductive knowledge of the world a* gained by previous 
experience with that domain of object^. Tins use of default 
values also allows a Frame representation to satisfy the 
"principle of continually available output" (Norman & 
lohrow, 197S), which says that a process should W able to 
provide a result Oven when iu analysis has not yet been 
completed. A lack of data or processing r#.sy«roes should 
produce a grateful degradation of the quality of the output, 
but not provent results from being produced at alL 


F, Variation 

A frame represents a certain limited dumain, and hence 
a range oF variation for objects which Sjclong to that 
domain. As ivc saw in the room scenario, the features of a 
frame may be frames Ln. their own right, embodying ranges, 
of variation. On entering a roam, you are prepared For 
certain typical pieces of furniture. A park bench or L i 
diamond-encrusted throne would be outside the permissible 
range oF variation, in this frame. Such an anomaly may 
indicate to the correction mechanism that another frame In 
called For, When a number of features are near the 
extremes of their ranges of variation, their collective- 
unlikeliness can cast doubt on the applicability of this 
frame end initiate a search for further evidence which may 
result In a new frame bring selected. This is particularly 
clear in medical diagmuia, where a set of symptoms may be 
possible within to# frome for disease X„ buL so unlikely 
that the doctor «4*tt further ttnii to search for a more 
plausible hypothesis. 


G. Perturbation and Prediction 

There are a number of different circumstances when a 
frame may be transformed or replaced by a different one. 


Benjamin J. Kuipers 


ISO 


While sitting in a room, if I turn my head, 1 luring a 
previously invisible region _ into my field of vision and lose 
a region . rom the other side, or I may move, changing the 
vantage paint from which 1 view certain features. These 
are relatively small changes which cause porlurhatlons of 
the Frame and die description it produces. I may 
■experience larger changes by talking into an other room, 
requiring a prediction ijf what frame E may need next and 
repenting the instanLislion process. These phenomena arc 
not isolated, but In* on a spectrum which includes Looking 
from o-utside the doorway, or Lying on the floor and looking 
up. These intermediate cas^s include more common 
information From the original frame than leaving the room 
entirely, and involve a mare drastic change Jo the frame 
than ?i perturbation. 

The common element to extract from these 
transformations is the idea of partially changing a 
description while saving those portions which are still valid 
for the new version, A transformation in viewpoint does 
not take place spontaneously. It occurs as the" result of 
some action (perhaps mental) with which we may he quite 
familiar; familiar enough, in fact, to be represented by a 
scenario frame. An action, like an object, has a 
description, which often tskea the form of a scenario. 
Frames may certainly he used, to represent the kinds of 
variability scenarios are subject to, just, at vision frames 
represent variability in visual descriptions. Tart of the 
frame for a given action will he a prediction of its cfFcct 
on commonly associated objects and environments. When I 
am walking, the "walking" Frame will predict the change in 
the visual geometry of the enclosing roam. Conversely, 
fclJ-ong visual cue# can be used very effectively, in movies 
for example, ip evoke the sensation of motion. 

When the action in question forces most of the 
description tP he redone, as when I walk from room to 
room, then the transformation. consists mostly of proposing 
possible new frames. In a familiar house I may bo able to 
summon up a fairly complete and accurate tlvscription from 
memory, but in an unfamiliar house I need time to get my 
bearings., For amall perturbations, however, such, as 
moving slightly within the tame rwm, the visual geometry 
of the outlines of the room may change slightly, but moat 
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of the Features will remain the same, md appear in 
correspond in;; places- on the walls, If A piece of furniture 
looks substantially different frnm the new angle,, sis own 
frame may require a transformation. 

Occlusion of objects m the background by those Ecl the 
foreground can be explained by their relative positions 
within tlie room description. I do not believe-, ]iowever, 
that people accurately predict such occlusion^ from their 
mental descriptions. On looking at a scene, the description 
I generate is not of tiie picture I see, bill of what I think 
that seene actually ia„ i come It? conclusions about the 
globaL nature of the scene from evidence ] have, and fill in 
with default values where 1 missed actual perception. 1 !. 

Hr Extreme Anomalies 

An extremely unexpected observation, such as opening 
that door and Finding myself at lire seash&r*, is treated in 
a more serious way. My dumbfoundedness resulting from 
tills occurrence is not only due to the time it takes to find 
a "seashore" frame, but I atn also Faced with evidence 
suggesting that previously accurate nations of continuity no 
longer hold. I do have sOmc knowledge of geography, and I 
am filled with cariosity about how I was transported tp 
the sea without noticing, I may decide to reject tho 
evidence mid the attack on continuity by concluding that I 
am dreaming or hove gone crazy. Alternatively, I may 
retreat back through the door and lock it, or in the best 
Kuhnian tradition, postpone dealing with such questions 
while I explore and gather more observations- The point of 
□ ll this is that sn extremely unexpected occurence calls into 
question not only the predicted frames that have proved to 
be inaccurate, but also that knowledge which led the 
prediction process so seriously astray. Such experiences are 
saved and incorporated into newer versions of the faulty 
frames when Structural revisions become possible. 
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IIL AN EXAMPLE! BLOCKS WORLD RECOGNITION 

Frames, then, Have an intuitive- appeal as. a metaphor to 
explain how people organize and represent their knowledge. 
An obvious- que-ition is, of course, whether tins idea is of 
any help to us in representing such knowledge in computer 
programs. The next example solves a very easy problem, 
One for which the machinery developed is cpiite superfluous. 
The hope, however, is that the way such problems, are 
soiled will provide valuable techniques to be used in 
solving larger, more realistic problems. 



parallelepiped 
■with, three 
visible faces 



Fig. 1 . The da main. 


The domain shown in Tig. 1 consist* of lino drawings of a 
single, unoccluded block, which can be either a 
parallelepiped with three visible faces, a wedge with three 
visible faces, or a wedge with two faxes visible. The blocks 
world has been used as a dc-mnin by a number of 
researchers in different contexts (Winston, 19711; Winograd, 
1372), and ia rightly criticised os a "toy" world, lacking 
many of the important and complex problems found in the 
real world. Much of the difficulty of real world domains 
cornea from our inability to express in a computer program 
descriptions and distinctions which arc obvious (though 
hard to verbalize) to a human being- The blocks world, 
however, has very clear descriptive met ban; sms, and Li is 
3My to find precise distinctions between two line drawings. 
In this domain we can focus on the nature of the 
recognition process, and how the use of frames in 
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manipulating a ad representing descriptions can aid th-nt 
P^ceiS, The hope i s that a simple "toy' example will 
clarify phenomena which would he obscured by other 
important (but separate) issues in a more complex domain. 

Five of the phenomena moiitioned in ( ] 1C previous 
seelttm will be addressed by the example- of the block 
recognition program; description, Inst ami at ion, predict ion, 
cor: uction., and tninsf orms-jon. TJie recognizer instantiates 
A description of the object it recog nizes f using its 
predictions to guide the recognition. When a conflict 
occurs between prediction and data, a complaint department 
associated with the frame selects an approoriaie course of 
action, often a transformation to a eicv. frame. 

What, then, dots the recogni7 r er take as Us. input and 
produce as its output? The "-sensory* world of this system 
consists of a body of data about Ehe line drawing which can 
be interrogated by asking it questions which are very local, 
in the sense that a particular part of the visual scene can 
be reached only by searching along a known edge from a 
vertex which has already been observed. An attractive 
metaphor is that of walking over a snowy field, attempting 
to interpret a hue drawing laid in pipes hidden under the 
Snow, More precisely, the sensory world consists of edffe^ 
and vertices, which can perform the foil owing operation! 
upon receipt of the appropriate message. 

A vertex will deliver its type, the erlges which 
terminate at it, and the sizes of tile angles 
between pairs of edges. This corresponds to the 
result of a "circular search” in the neighborhood 
of a vertex. The type of a vertex is L, fork, or 
arrow. The size of an angle can be described as 
either acute,, right, or obtuse. 

An edge will deliver its "other vertex" upon 
being presented with one vortex. This 
corresponds to scanning an edge from one -vertex 
to the other. 

With this limited sensory world, and even more 
impoverished descriptive system, the recognizer will attempt 
to recognize what it sees and provide a global description 
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of that object. It is important to recognLie the- diFference 
between the sensory world which is ^aihblc, and the 
descriptive mechanism v.-hkh creates an internal 

represent at ion tu he remembered. Even Lf the sensory 

world provided precise angle measurements, the reeog'niter 
conk! Only describe them as acute, right, or obtuse. 
Similarly people discard or blur many distinctions which 
are physiologically available to their senses. 

What is the description of a line drawing? A 
description imposes a level of organ Iso lion on the 

observational data which is not locally apparent in the 
scene itself. Simply by staling that an object is, say, a 
cube,, the description asserts that a certain col lection of 
features appears in the scene and that many others do riot, 
a fact which could be determined directly Only by 
exhaustively searching the jscene. The description also 

provides a global structure to the features which is not 
apparent Ln the Local relations of the scene. Thus, looking 
at one corner of a cube, one may ask of the description, 
"Where Is llic opposite corner?' The scene cannot answer 
such a question, for it cannot define "opposite' in a way 
that is meaningful to the cube. A third function of the 
description is to include properties of the object which arc 
inferred from the observed Features along with the 
knowledge of its identity, such as the volume of a cube hr 
wedge. The description produced by this recognizer will 
fill only the first two functions, noting collections of 
features and providing a global relational struclure, A line 
drawing will be classified according to type, and its ports 
will be accessible according to the global structure of the 
object it represent*. 

The recognition problem in this blocks world domain is 
to select and instantiate the correct frame for the drawing. 
Since, however, Instantiation must begin . before selection 
can take place, the recognizer must also evaluate observed 
evidence, predict subsequent observations, select a new 
frame when necessary, and save previously collected 
observations. 

Having defined ihe problem, we can now begin to look 
at what the recognizer is. The recognizer consist* of three 
frames, one for each type of object in the domain. Euch 
frame is a program for examining the input data and 
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constructing a description of its type of block from that 
data. A frame has many of the properties of a description, 
in that it imposes its own global organjaalion on the 
observed data and makes predictions based on its 
observations along with its assumptions about the type of 
object being observed. An important similarity between a 
frame and I he corresponding description is that a Frame 
will lie able to answer quest Loo; about as yet unobserved 
portions of the scene based on Lis predictions. Thus a 
frame functions as a complete (though possibly erroneous) 
description even before Lis processing Ls complete. 

A frame, however, has additional capabilities which ore 
not present (or necessary) in a description. It contains 
Strategy knowledge which can advise it on the best 
observations to consider as it but Id; its description. It also 
has the ability to evaluate the observations for consistency 
with the description it is attempting to instantiate, and to 
turn the process over to a more appropriate frame when a 
fatal inconsistency appears, During the recognition process 
this description servos as a hypothesis about the .scene 
which the frame is attempting to confirm or refute, When 
the hypothesis is i-efuled, however,, it is not poly the 
description which it replaced by a better alter native, The 
new Frame also contains new knowledge about strategy, 
evaluation, and Lbr; handling of inconsistencies in ways that 
are more appropriate to the new hypothesis. 

There are two distinct kinds of knowledge about the 
features of these line drawings which are embedded in the 
frame and ivhich guide the construction of the description. 
The first is local knowledge about the types of vertices 
which appear in the figure, and how each vertex is 
connected to its immediate neighbor. The second is 
knowledge of the global relations which hold among the 
angles in different part; of the drawing (see Fig. 3), These 
global relations allow an observed angle measurement in one 
part of the drawing to predict an observation in another 
part. Both kinds of knowledge serve the same role of 
predicting observations and guiding the recognition process, 
but they interact with observations in different ways, and 
the details of their representation in the frame are 
somewhat different. 
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A. Recognition Scenario 

Let us follow a .scenario of the recognition of a block 
drawing,, Lti this case the three'face view of a wedgi;- 
Figure 2 shows the stages of the recognition process, with, 
observed data indicated in. solid lines and hypothetical 
knowledge in dotted lines, The first drawing is the actual 
scene, with the vertices numbered in the order in which 
they will he explored. 

Vertex 1: We start the recognition process by giving 
the program an initial vertex which in this case happens 
to be an L-vertex. The initial hypothesis is thac the figure 
is a parallelepiped, indicated hy the dotted lines in the 
figure. The single angLe measurement, a long with the 
parallelepiped hypothesis, predicts the sifres of the tour 
additional angles indicated. 

Vertex 2; The second vertex observed agrees completely 
with the hypothesis, which expected an arrow vertex and 
had- a particular measurement anticipated for the left side 
angle of the arrow. The two other angle measurements 
provided by tbs arrow allow the frame to predict every 
angle expected in the parallelepiped, Figure 3 shows the 
global angle relations which support this extensive 
prediction. 

Vertex 3: This is an arrow vertex, which is the vertex- 
type predicted by fho current hypothesis. At this point we 
can sea that the angle is too smsll t and that the figure 
cannot be a parallelepiped.. If the program had boon given 
better angle resolution, the angte specialist would also have 
noticed the error in angle and would have complained to 
the frame, We are assuming, however that the system 
cannot discriminate well enough, s* the angle specialist 
accepts the information os consistent, and the recognizer 
continues with a mistaken hypothesis. 

Vertex d: The fork-vertex at the c en ter of the figu re 
also corresponds completely with the parallelepiped 
hypothesis. One complete face has now been observed and 
confirmed. 
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Vertex 5: With this observation, the parallelepiped 
hypothesis finally breaks down, The I,-vnr tex specialist 
observes Rn unexpected lyf* «f vertex and complains to the 
framer ”1 expected, an I*. hut got an arrow," The 
para LLeLe piped frame know* that this particular problem 
Indicates. a transition to the threo-faco view of the wedge. 
It then analyses the complaining vertex and the data 
already cat lee ted la discover the correspondence between the 
cube and wedge frames which vilL allow previously collected 
data to be retained. finally, it executes the selected 
trails form at ion. 

Notice some fancy stepping here. The u jiex jn'clcd arrow 
vertex was an Anomaly to Ute parallelepiped frame, end the 
information contained in it could not be completely 
processed by the L-vert ex specialist. Thus it was ignored, 
and the transition to the wedge frame took place with only 
the previously known data. Once the new frame was in 
control, it could deal with the arrow vertex. The arrow 
vertex, in effect, caused the recognizer to do a "double 
take". 

Vertex 6: At this point, with the thr**-Face wedge 
frame directing the exploration, there is only one remaining 
vertex, and it completely confirm* tills hypothesis. The 
frame is rmw fully instantiated, 


B. Representation 

A frame is built around a hypothetical description. The 
elements of that description are represented by active 
program objects (called ''specialists") which interact by 
sending messages to each other. Each vertex in the 
drawing is represented by a specialist in one of the vertex 
types: Lj fork, or arrow. The properties of that type of 
vertex are represented by the particular behavior oT that 
specialist. A vertex specialist has pointers to each of the 
edges terminating at it. An edge is also represented by a 
specialist with pointers to its two vertices. This network 
of specialists connected with pointers represents the 
topological connectivity of the line drawing. The network 
makes implicit predictions by stating that if a vertex 
specialist ls satisfied with the real (observed) vertex 
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corresponding to it, then a scan along one of the edgos 
should encounter another real ve-rlcs which will satisfy that 
corresponding veriest specialist, Once an initial 
correspondence has been established, between observation 
and hypothesis, this constitutes a prediction of all the 
vertex types and their connections throughout the Figure. 
Th is predict ion is embedded sn the structure of the frame, 
and cann&t be changed by Incoming data, except hy refuting 
the hypothesis and replacing the frame with another one- 
New angle predictions, on the other hand, can ho freely 
sent among angle specialists throughout the figure. The 
relations among the angles in the line drawing [Fig. 3) are 
represented fay a agio and relation specialists, who 
communicate prediction and observations among themselves. 
Ely this communication, an angle observation in one part of 
the Figure can affect the prediction in a remote part oF the 
figure. Th# edges, the faces, and the block as a whole! an? 
also represented by specialists, sending messages to each 
Other, wlui.se behavior directs the recognition and 
instantiation process. 



Fig. 3, Global .lnjln relations in the parallel*plyid frame. 
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(L The li:t.sE(.: Loop 

The basic operation of the recogr.ition process Li to 
select an observation ami evaluate it with respect to the 
predict]ona triads by the CuTrent frame hypothesis, The 
flow of control described here includes the decisions about 
search strategy,, sending observations to corresponding 
specialists for evaluation, and communicating predictions 
and additional data between special is U, [t is important to 
notice that these design decisions can be changed 
independently. For example, th tt selection of the next 
observation can be made in u different way without 
changing tine rest of the flow of control, The range of 
flexibility oF these design decisions wj] 1 be the topic of the 
Last section of this chapter r Since the frame consists of a 
number of apecfclijts, each with its own behavior, the 
description of the normal flow of control wilt also describe 
much of Lht; behavior of those specialists 

(1) When instantiation begins, sin initial observed vertex 

is, sent tcj. the recognizer. Since the initial "cube' 1 

hypothesis is symmetrical, thij Correspondence between 
hypothesis and data is set up by sending the observed 
vertex to an arbitrary vertex specialist of the same type. 
After this, the specialist for the entire block directs, the 
instantiation. 

(2) When the block specialist is told to Atlucf an 

observatio-n. it cycles through its faces, telling each in, turn 
to select the observation. 

(3) When a face specialist is told to select an 

observation, it cycles through its edges, telling each in turn 
to select an observation,. If they all refuse, the fees passes 
the refusal back to the block spocialist- 

(d) When an edge specialist is told to select an 

■ahsorvation, it checks to see if it. is :n a very particular 
slate. It can make an observation only if: a real edge has 
been observed corresponding to it end exactly one cd the 
vertex specialists at its ends has observed a corresponding 
real vertex. If this state of affaire obtains, the edge 
specialist performs the scan from on* end of the real edge 
to the other, and sends the newly observed real vertex to 
its corresponding vertex specialist! Otherwise, a refusal goes 
hack to the face specialist. 
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(50 When a verier specialist receive* an observed vertex, 
jl evaluates the observation against Us prediction, by 
checking to -see if the observed type is the same a* what it 
expected. If not, 4 complaint goes to the complaint 
department {more on this in the next section). If the type 
is acceptable, the vertex specialist obtains th* real edges 
and 3 ng le measurements which are available front the 
Observed vertex, It sends the observed edges ta the 
corresponding edge specialists, and (.lie observed angle 
measurements lo the angle specialists. 

(■G) When an edge aptoialisi receives an observed edge 
from one of its neighboring vertex specialists, it remembers 
th£ real edge, and the real vertex at one end, so it can 
respond differently to future requests for observations. 

( 1 .! When an angle specialist rc-ccavos an observed angle 
measurement, it Compares the measurement against, any 
prediction it might have. A conflict,, of coarse, results in a 
complaint sent to the complaint department, If there was no 
previous prediction, the measurement mil bo of Interest to 
the specialist (called a relation") which represents the 
relation among some collection of angles sn the figure, so 
the observed measurement is sent on. An example of such 
a solution is that holding between the four angles of a 
parallelogram, 

(8) When a relation receives such measurement, it 
dfccides whether this measurement implies some useful 
pr-c-diction. If -to, it sends that prediction to the 
appropriate angle specialists. 

{9} When an or.gle specialist receives such a prediction, 
it simply remembers it for comparison with future 
observations. 


D, The Complaint Department 

A :rome has a complaint department which receives 
complaints about violated expectations from the vertex and 
angle specialists, The offended specialist sends a 
description of the problem from its own local point of view, 
and the complaint department, with Its more global 
knowledge, must select the proper course! of action. In this 
example, only the parallelepiped frame has a nontrivial 
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complaint department. There arc three distinct responses, it 
can make. It can decide ill at the observed anomaly 
indicates that the object being recognised is aelually the 
three face view of the wedge, far example, acid that Lt can 
determine the Correspondence between what- has already 
been observed and the data expected by the three-face 
wedge frame. The seme can happen tn indicate a transition 
to- the twy-i'ace view of the wedge. The llnrd alternative 
(Fig. is somewhat more i me resting. The complaint 
department has enough information to decide conclusively 
that, the new fratne should be the three-face wedge-, hut it 
does not have Sufficient data to select the correspondence 
between the old und the new frames. It a*nnot decide 
which face will be. the triangle. The solution adopted In 
this recognizer is to continue the recognition process under 
the old hypothesis (now known Lo be mistaken), under the 
assumption that the next complaint wilt he able to settle 
the £|nestion. This decision is based on knowledge of the 
domain which assures the recognizor that no important data 
w:]| be lost while working: under this mistaken liypotbesii. 
I do not address the question of how such knowledge cun 
bo automatically act[uip«d from experience. 



tig. 4. The niwhi^uous transit tem: ihr I r.itrifl can(lCl predict 
which si-rtfi wit] he the triatLgJtt. 

Table I summarises the promt by which the complaint 
department deals with anomalies and selects the new frame. 
The alternative "continue (three-face wedge]" is the cas* 
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discussed immediately above, Tin; complexity of tEie 
comp Lain t -department is a result of the number of 
comp La [fits which are meaningful, and hence of (lie number 
of alternate frames known to this frame, This table docs 
not show the fairly elaborate decision procedure for 
determining the correspondence between the two frames 
before Hie transition cad actually be executed. 


TABLE L 

The Com plaint Dcparlmtnt 


Vertex specialist 

expccind irrrow, gat L =*> Iw^-fare wedge 
expected L, £*t arrow =*> thlSc-lato wedge 

Angle larger than ?xpecLed --> thrcc-Eate wedge 

Angle smaller than expected: 

In L vertex ■=-> twp-fass Wedge 

in arrow vertex: 

full angle =*> continue (thrce-Fagf wedge) 
tide angle: 

Observed L vertex ip that face «> tw*-fece wedge 
die "*> continue C three-face wedga) 
in f^rlt vertex = *> three-race w^dge 


E, Tiie Trantrjtion 

Once an anomaly has refuted the parallelepiped 
hypothesis, amd v. more appropriate wedge frame has been 
selected, the problem rents ins of ectuslLy performing the 
transition. The simplest solution would be to start over, 
Snoring previously collected data except to indicate a 
different frame to start with. This form of recognition is 
a blind, back-tracking search through a space of line 
drawings. One goal of this example, however, is to show 
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haw frame-based recognition can exploit the aimilsraties 
between ditie-nent line drawings to preserve obitir vat ions 
colletled und^r a mistaken hypothesis. At the very least, 
the a■■ '■ i-i■ observation? pF edges ami vertices can be mapped 
from the eld description to the new one became the 
definitions of adjacency and connectivity are shared by M 
frames Ui this dorpjJiin, In favorable ciretarnskances, tiigiirr - 
level descriptive objects, such a* a parailetagram face, will 
rejn&in valid in the nsw frame without disturbing their 
internal structure. 

The transition from the purall«ltpiped fram 0 to the 
inree j^ce v low of the wedge h 3 :& these lavofablfi properties^ 
The difftrcticcE between the two descriptions nre confined 
to changing one parallelogram face to a triangular face, and 
adjusting the angl* predictions. To accomplish this 
transition, the parallelepiped frame replaces the collection 
C: - special [.5 ta which represent one pun lining ram face with 
another collection L'cr a triangle, It transfers whatever data 
has already been observed to the corresponding new 
Specialists, notifies ail concerned neighbors of the change, 
tiiiid Ihe displaced parts of the old description disappear. 
The internal structure of the neighboring faces changes 
only m accepting a now painter. The angle predictions also 
vanish, but new predictions ar* solicited from the angle 
specialists. 

ihe transition to the two-face wedge is i|nite different, 
however. The change here involves much more extensive 
changes to the structure of the description. Ju E { as in the 
other transition, there is a correspondence between the 
representing specialists in the two frames, but in thi? case 
apedalists who correspond may not have the same behavior. 
Fa&cs which had two neighbors’ now have only one; vertices 
which expected to be -arrow? will now be Ls; and before, 
the angle predictions become obsolete- In this case* atl 
that can be .salvaged from the old frame are the actual 
observations, including the connections between them, 
Ihese ^ Qlj&orvationj axe trftfhsF erred to corresponds rig 
special Sits in the Lwc-fsce wedge- frame, which incorporates 
ita own higher-level descriptive structure. TherE is still an 
important saving in observations to be investigated, but not 
as much program structure can be shared between th£ two-- 
face wgdge and the parallelepiped as was passible between 
Uic parallelepiped and the three-face wedge. 
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3r\ The innilcmentotson. 

This example was first programmed 3 pd hand-simulated 
in ACTORS (Smith & Hewitt, l<)74). As the ideas 
con tin tied to tvohe, a working i m piemen La Lion in 

SMALLTALK (Kay, 1974) was written and debugged in less 
than two weeks. The ease with which the concept could be 
translated into a working program as primarily duo to the 
tu^el semantics of ihese Lwo languages. I3olh ACTORS and 
SMALLTALK evolved from (lie ideas in SIMULA (Dahl & 
Hoaro, ID' - i), and are wha t might be called outer languages, 
as opposed to function or procedure latiffdoges like LISE 5 or 
ALGOL. An actor Is a procedure which can maintain 
internal at ate between invocations. Actors communicate by 
sending messages, to each other, and are not constrained to 
send messages for control) only up or down a function-call 
hierarchy. Allowing an actor to maintain an internal state 
makes it possible for the variables which are intuitively 
associated ^wLth, a conceptual object ta be associated 
dirctdly with the corresponding pre-grant object- 

A certain amount of confusion is possible between the 
different types of instantiation in this ex ample. A 
specialist representing u feature of the line drawing (for 
example,, an arrow-vertex specie List) is written as ait actor 
which maintains a certain amount of internal state, and has 
a certain behavior in response to particular messages. The 
parallelepiped frame contains three Copies of the arrow- 
vertex specialist, each of which is an instance of the actor 
mentioned above■ These three instances are not identical, 
but can be distinguished by which other specialists they 
have as neighbors. The parallelepiped frame, then, is a 
program which consists of several parts, some of which 
share program text but have different internal states. This 
2 came is then provided with a source of observational data.. 
Instantiation of the description is the process by which the 
various parts of the frame establish a correspondence with 
observational data- To add further to the confusion, wo 
can imagine a stone containing twi? on occluded blocks, fur 
which we make two copies (instances) of the entire 
recognizer, iso that separate frames can be instantiated, 
resulting in lwo independent descriptions, This third case 
seems to have no theoretical interest. 
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IV. WHAT DOES THIS ALL MEAN? 

Let ns slep back nnw and see what significance this 
example has in the larger enterprise- of representing 
knowledge for recognition. The overall structure of Hie 
recognizer has some applicability to other domains in which 
greater expressive power is requ [ red yf the descriptivu 
mechanism, Jri the following sections,, I discuss the general 
ton this ions which con he drawn about the de^cri ptiv^ 
mocmanisms used, ami about the interesting modules u.hicb 
supervise the recognition and instantiation processes. Other 
domains which have been investigated in some depth, and 
from which 1 draw examples, ?re medical diagnosis (Rubin, 
1975), and electronic circuits (Sussman, t973). These other 
domains can show features which fit into the framework, f 
have developed, hut which do. m>l appear in the blocks 
world. Where possible, I point out the rings of 
applicability of _ this framework for recognition, and give 
examples where it does not apply, 


A. Representing the Hypothesis 

The block recognizer uses three methods. to represent 
hypotheses about line drawings, They are: 

* the vert ex‘specialist?;, which know about a particular 
type of vertex to which they expect to correspond: 

* the network of neighbor pointers, which links the 
nnd vertex-apecialists, and bomoniorph [tally represent* 

th^ Connectivity of the edges and vertices in the drawings 

* the angle specialists, which represent the global 
relations among the angle measurements, and actively 
communicate predictions about particular angles. 

This division of repreaenta tic rial effort works, in the blocks 
domain because a clear distinction can be made between th£ 
different properties to be represented. There are strictly 
Eocal features (the vertex types), fixed global relation* (the 
connectivity between vertices and edges), and predictive 
global relations (the angle relations). 
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- >^Ln. ui -n.T dfjiJLpiic].c, fit lI - :L u the 5..jiiir- d-escriptive 
framework W that this distinction between Joca] and global 
LE-atur^^ cflfi be cl-wirly made, A good example q { thia is 
the domain of electronic circuit*, where tin* connectivity 
aiii lota 2 pro pet tits of co-mponenta nvasi also he represented, 
and global refit Lon ships .'ijstor.g current and voltage 
measurements at different points cact b* predicted. A less 
geometric example with the same jogiml structure might be 
representing the time course of certain diseases, wliere local 
specialists are able to recognize particular symptoms, the 
network of connections is a partial time order Eng of events, 
and the global relations may bo among (be different 
measurements of a varying quantity, such as blood pressor? 
Or while blood ceil count. 

There are, of course, many domains where the 
representational structure described in this example does 
not clearly apply. This i$ particularly true when features 
are not discretely separable as they are in the blocks 
world. For example, in medicine it can be important to 
describe the onset of a certain symptom as "insidious", or 
otherwise specify an indefinite time interval which can 
overlap with other events. Notice that we are not simply 
specifying an interval whose endpoints are discrete (though 
Currently unknown), but rather an interval which fails to 
possess definite rad points. The network re present? lion 
described above lacks the expressive power to deal 
adequately with this phenomenon. 


15, Manipulating the Hypotheses 

In the previous section, we what kind of expressive 
power is available for represen:i 11 % hypotheses to this kind 
of recognizer. Now let us cattail] cr the structure provided 
to manipulate thos* hypotheses. It consists of four parts, 

a module to select the next observation to- consider; 

3 module to evaluate the observation, comparing it 
with what was predicted; 

* a modulo to serve as a complaint department, deciding 
w-bat to do in response- to an observed anomaly; 
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* imodult io- perform the IransitLon to a nt«f frame, 
prCMH-ving as much as possible of the old information. 

FlIeso niCiJ tiles do riot coTrexjigrid lo segregated pieces of 
program Ln the block recognizer, hut are design units whose 
implementation is likely to be distributed among the 
specialists which comprise Els# frame. 

In the following sections, w e will gamine thnst modules 
i ndi vidua Ely and see what range of behavior can. Sap expected 
of them. The important questions to ask of efich one are: 
'' Ita. is it asked to do? What knowledge cart it, consider? 
What answers can it give? This modularised view of th c 
recognition process aUo lias its limitations, again because: of 
the diacrate structure of frames linked by explicit 
transitions. This simplified view of recognition is based on 
the assumption that recognition proceeds by adopting a 
-single best guo$s hypothesis, and modifying it to e better 
one in response io an unexpected observation. Thera is no 
provision^ sor entertaining several different hypotheses at 
once, or :or leaping to an unrelated frame where no explicit 
link^ exists. There art also important Questions about 
sharing knowledge among distinct frames which are not 
addressed in this domain. 


C. Selecting the Noxl Observation 

Tliis module decides which potential observation would, 
be most useful n\ each point in the recognition process, 
flitte ]t. has selHjctcd one, it sends the observed data to the 
appropriate specialist to begin the evaluation. The 
interesting tlLing about this module t-s the range of 
information it can consider, and whore it obtains that- 
information. In the blyck recognition example a particuLax 
set of con tide rations is designed into the selector, so it 
does not answer the questions below Each time it makes an 
observation. Doctors, on the other hand, are trained to ask 
thest questions explicitly in the course of a medical 
exa mi nation. 

, * ‘uiven what has already been observed, which altarnate 

hypotheses are the most likely? (a.e. for differential 
diagnosis) 
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* The frame use* observed data to re Fine its predictions 
and the description, it is producing. Which observations 
would be mail productive a( this lime? 

* The pragmatic context at" this recognition art makes 
certain parts of the description more useful than others. 
Which arc these? 

* What coats (e.g. pain, risk, money, doctor's time) are 
associated with potential observations? 

There are, of course, some rases where the relative 
importance of these factors may he decided once and Fgr sill 
Siidl tiesigoed into the selection procedure., and others- ‘where 
the si ion lion must he actively and frequently rcwul ua tedt- 
Differential diagnosis informs Lion may he requested by the 
com plaint department in cases where an anomaly has been 
observed, but a unique replacement hypothesis cannot be 
selected. 


D. Evaluating 1 fat Observation 

This evaluation is a point of close contact between the 
representation and the manipulation of the hypothesis. The 
frame checks an observation against its hypothesis. Asking 
whether that observation is consistent with the predicted 
description. The discussion of repjresv-ntation above 
illustrates the local nature of this evaluation in the block 
recognizer, The- appropriate vertex And angle specialists 
each check the consistency of llic new information with 
their expectations. The complexity lies in the range of 
potential results of this eva] nation. in the block 
recognirer,, only the first two of the following possible 
reactions can occur. 

* The observation is consistent with the hypothesis, 
perhaps providing additional information to be Absorbed by 
the frame, 

* It is inconsistent, refuting the hypothesis, and the 
specialist sends a description of the problem to the 
complaint department. 
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* It is consistent with the current hypothesis, hot 
singles out a special ease about which more knowledge is 
a vo [table. 

* It, in isolation* is consistent with the current 
hypothesis* the ugh near the edge of the range of valuation. 
However*' enough other observations are also near the rulgcs 
of their ranges of variation that the fr^me becomes 
suspicious and complains Lo the complaint department. 

The third, or -further specification” link between frames 
provides additional information which allows more detailed 
predictions Or better selection of observations. The fourth 
possibility allows suspicion to be cast on a hypothesis as it 
becomes more and more unlikely, even though it may never 
be conclusively refuted, It may nonetheless be replaced by 
a better alternative, 


£, Selecting a New Hypothesis 

This module, the complaint department, is given a 
description of the Current complaint (and perhaps 
remembers past Ones], and is asked to select a new 
hypothesis. 1 is the block recognizer, most of the possible 
anomalies simply specify unambiguously the frame which 
should replace the current one. As we saw above, however, 
there arc cases in which further information is necessary to 
select the correct orientation for the new frame. In either 
mode the complaint department must possess knowledge 
about which alternate hypotheses are available, In most 
cases of practical recognition these decisions will bo reduced 
to simple tests of the observations, just as in the blo-ck 
recognizer, rather than active problem-solving during the 
recognition process. The Speed of fr£mc-based recognition 
depends Oh th« assumption that the number of potential 
alternatives in a domain is manageable* ana that most 
anomalies clearly suggest alternate hypotheses. 

Tlig eventual answer provided by the complaint 
department should be a new frame to replace the 
complaining one. Some of the potential courses of action 
leading to this result are: 
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* the anomaly may simply specify a new hypothesis to 
replace the old; 

* there may be previously collected in Formation which 
can he reexamined in more detail it? decide between 
potential new frames; 

* the complaint department may request a particular 
observation fur differential diagnosis from the module 
which selects the observations] 

* jF the anomaly is minor, or there Are no good 
alternatives, the current frame may just remember the 
problem and continue under the old hypo I beefs, hoping that 
further observation will iliuminate the situation, 

The complaint department is also involved in 
representing the frame's, range of variation, Each feature 
Of the frame description has tls own range of variation 
which si wilL Accept before complaining. The' complaint 
department may then decide io disregard certain complaints 
or accept excuses under some circumstances, A frame 
system could believe that ail dogs have tails, liul admit tbs 
possibility that a dog without a tail could still he a dog. 


F. Translating knowledge to the; New Hypothesis 

At this early, somewhat speculative stage of research, it 
ia considerably harder 10 generalise about the transition 
procedures than it is to talk about the other parts of the 
recog niietr The other parts of the recognition process 
depend largely on the properties of the domain; the 
transition depends on the structure of the description. 
Since that structure is one of the goals of our research, 
any conclusions drawn from it are necessarily tentative. 
Another caveat is that the blocks world domain was 
deliberately chosen to mini ml W the complexity of the 
descriptive and expressive problems to be encountered. 

As I mentioned, previously, the hierarchical structure of 
the description is important in determining how much can 
be saved in replacing one frame with another. When ft 
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larse, self-contained autisl rue ture such as a parallelogram 
nice ls esifentially tSa* same an Iho two dfstri p\ ions, it is 
Fm-ural io preserve it as a unit rather than reconstructing 
il in the new frame. Even mars than this is true in the 
tranii(ioii to the three-face wedge; only a few pari* of the 
top-level description need to be’ chafed.. The rest of the 
description remains the ^amc. 

En making the transition to (he two-face wedge, the 
iiigher structures of the two descriptions hfc quite 
different, so less of the old description can be preserved. 
Ihs interpretation of the observations remains the same, 
however: if two parts are considered eon nee tod by the 

parallelepiped frame, they arc connected in the wedge 
frame, and the bmt in which they are described are the 
sarnE, 1 hiss when the recognizer realizes it is looking at a 
wedge, it can remember what it saw whan it thought the 
object was a parallelepiped. Even when the higher-level 
aescrjpttve structure must be replaced, the recognizer need 
not Look. £iviin at features il has :streacly obii*.;rved 4 

Here again we see Em example where we are helped oui 
by the good behavior of the domain, or at least of our view 
oF 1 ho domain, Even, when the frame changes, the 
interpretation of the observations remains much the same.. 
ThEi need not be true in domains with segmentation 
problems. For escimplo, in speech recognition, changing the 
interpretation of one segment may affect the boundaries of 
the segment, requiring changes which rippLe outward to 
neighboring hypotheses. A different set of techniques is 
required to state and evaluate hypotheses about domains 
where segmentation is an important problem. 


V. SUMMARY 

In this chapter we presented the idea of Frames in a 
very intuitive way, outlining a number of desirable 
features of a representation for knowledge, and illustrating 
them with a Specific Rumple from the blocks world. A 
frame is a specialist in a small domain. It contains the 
knowledge necessary to create a dosed ot ion of an element 
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at its domain from observed data. The features of cucli a 
description may he frames :in their ckji right, represc-nting 
a r * n £* of variation permitted ip (hat. domain. Tim frame 
for on object can have associated wlih it frames for actions 
wKicIi commonly of feci that object* so that pl-od ict ions can 
be made about required mod ifLeations to tbc description. 
The frame is capable oF predicting wnobserved features, acid 
of using previous observations to refip* its predictions. 
These predictions can guide the recognition process, and 
provide answers to questions before that process is 

complete, An observation which is inconsistent V. ith the 
frames expectations ran suggest a better frame as a 
replacement. Much of the partially constructed description 
can be incorporated into the new frame, which continues 
the recognition process. 

It is important to recognise the value of the intuitive 
model presented above. In a sense it is a "wish list" of 
desirable properties for a representation, but it is a list 

compiled with ths djbIi] ems of effective com put ability in 

mind. It will be many years before the technical problems 
implied by a framo theory can lie precisely stated and 
solved. Such intuitions are therefore all the more 

important for providing a context in which current research 
can be viewed. 
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